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We propose here a stochastic binary element whose transition rate depends on its state at a fixed 
interval in the past. With this delayed stochastic transition this is one of the simplest dynamical 
models under the influence of "noise" and "delay". We demonstrate numerically and analytically 
■ that we can observe resonant phenomena between the oscillatory behavior due to noise and that 

due to delay. 
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Resonant behavior is one of the most studied and utilized fundamental physical phenomena. As well as being of 
interest in a variety of fields of physics, ranging from elementary particle experiments, such as resonance analyzed 
with the Breit-Wigner formula jj| to resonant electrical circuits ||, it has recently been actively investigated in the 
context of biological information processing as an application of stochastic resonance (see, e.g., ||-|(|)- In these studies, 
noise, which is normally considered an obstacle to information processing, is treated as an enhancer of information 
£j ■ processing through its resonance with external signals. It is known that delay, which is another element present and 
— '! studied in biological phenomena and information processing (see, e.g., [0J|]), can cause a complex oscillatory behavior 
in an otherwise simple, stable dynamical system. Analogous resonant phenomena with respect to delay have also 
been noted and investigated. In ||, for example, the effect of delay in a lateral inhibition in a neural network is 
. investigated both experimentally and theoretically. It is found that delayed lateral inhibition can cause amplification 
of neural responses to sinusoidal stimuli in spite of the fact that, without delay, these inhibition generally attenuates 
Cn| . such responses. 

The main theme of this paper is presentation of a simple model which shows that delay and noise can have a 
resonance between themselves without an external periodic driving force. Our model is a two state system whose 
dynamics is governed by combinations of its state at some fixed interval in the past and noise with a certain width. 
In the probability space, this model can be described as a stochastic binary element whose transition probability 
depends on its state at some fixed interval in the past. Thus, in this description the model can be considered as a 
previously studied "delayed random walk" [jlO| except that it can only take two states. With a fixed delay, we show 
analytically and numerically that such a model has a residence time histogram which shows a peak of maximum 
height with appropriately chosen transition probability, i.e., noise and delay "tuned" together exhibit a resonance. 
From the point of view of stochastic resonance, this is a new type and one of the simplest models which is analytically 
tractable. We conclude the report with a discussion of possible utilization of such a resonant behavior with noise and 
delay. 

Before presenting our model, we briefly discuss a numerical study on a simple one dimensional system to illustrate 
the physics motivating proposal of the model. Let us consider a simple one dimensional map dynamics with noise £ 
and delay t, which is formally given by 



z(t+l)=ta,vh\j3(z(t-T)-9)]+Z L (1) 
(3 and 9 are parameters and £l has the following probability distribution. 
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P (Z = U ) = JZ (-L<u<L) 

= (u<-L,u> L) (2) 

In words, £l is a time uncorrelated uniformly distributed noise taking the range (— L, L). This map can be considered 
as a discrete time correspondence of the following differential equation model. 

dz d Tr , . 

K(z) = iz 2 (t) - ± log[cosh(/?(z(i - r) - 0))] (3) 

The shape of the asymmetric potential V(z) with no delay is shown in Fig 1(A). We have numerically simulated the 
map (|l|) with various noise width and delay and found that we can have a regular spiking behavior as shown in Fig 
1(C) for tuned noise width and delay. Also, we have observed that the signal to noise ratio of the corresponding 
peak in the Fourier spectrum goes through a maximum with varying noise width as is generally found in a system 
showing a stochastic resonance fTlj| . We can qualitatively argue that the delay alters the effective potential into an 
oscillatory one just like that due to an external oscillating force leading to a stochastic resonance with tuned noise 
width. The analysis of the dynamics given by (Q) or (^), however, is a non-trivial task. Our model is an approximate 
abstraction of this dynamics retaining asymmetric stochastic transition and delay in order to gain insight into the 
resonant behavior between noise and delay. 
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FIG. 1. (A) The shape of the asymmetric potential for f3 = 2.0 and 6 = 0.1. Also the typical dynamics of Z(t) from the 
map model as we change noise width L. The values of L are (B) L = 0.2, (C) L = 0.4, (D) L — 0.8. The data is taken with 
t = 20, 13 = 2.0, 6 = 0.1 and the initial condition Z(t) = 0.0 for t G [-T, 0]. The plots are shown between t = 1000 to 2000. 

Let us now describe our model in detail. The state of the system X(t) at time step t can take either —1 or 1. With 
the same noise £l, we can define our model formally. 

X(t+l) = 9[f(X(t-T))+£ L ], 

f(n) = ~((a + b)+n(a-b)), 

6[n] = 1 (0 < n), -1 (0 > n), (4) 

where a and b are parameters such that \a\ < L and |6| < L, and r is the delay. In relation to the map (0), this model 
is an approximate discretization of space into two states with a and b controlling the bias of transition (reflecting the 
two different barrier heights from the two stationary points of the potential) , depending on the state of X at r steps 
before. 
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This model can be described in the probability space more concisely as shown in Figure 2. 



FIG. 2. Schematic view of the stochastic model dynamics. 



The formal definition is given as follows: 



P(M+i) 
P(-M + i) 



p 
q 



P , X(t-T) = -1, 
1-q, X(t-r) = l, 
q, X(t-T)=l, 

1-p, X(t-r) = -l, 
1 



(1 



L" 



(5) 



where P(s, t) is a probability that X(t) — s. Hence, the transition probability of the model depends on its state at r 
steps past and is a special case of delayed random walks . 

We first investigate the model numerically and observe that a qualitatively similar feature to those shown in Figure 
1 appears. We randomly generate X(t) for the interval t — (— r, 0). Simulations are performed in which parameters 
are varied and X(t) is recorded up to 10 6 steps. From the trajectory X(t), we construct a residence time histogram 
h{u) for the system to be in the state — 1 for u consecutive steps. Some examples of histograms and corresponding 
X(t) are shown in Figure 3 (q = 1 — q = 0.5, r = 10). We note that with p « 0.5, as in Figure 3(A), the model 
has a tendency to switch or spike to X = 1 state after the time step interval of t. But the spike trains do not last 
long and result in a small peak in the histogram. For the case of Figure 3(C) where p is closer to 0.5, we observe less 
regular transitions and the peak height is again small. With appropriate p as in Figure 3(B), spikes tend to appear 
at interval r more frequently, resulting in higher peaks in the histogram. 
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FIG. 3. Residence time histogram and dynamics of X(t) as we change p. The values of p are (A) p = 0.005, (B) p = 0.05, 
(C) p = 0.2. The solid line in the histogram is from the analytical expression given in equations (8,9,10) 
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This change of peak height in histograms which reaches maximum at an appropriate noise level is one way to 
characterize stochastic resonance. Choosing an appropriate p is equivalent to "tuning" noise width L with other 
parameters appropriately fixed. In this sense, our model shares a feature of the stochastic resonance. It can be 
classified among models of stochastic resonance without an external signal p2| . The difference and the new point 
is the use of delay as a source of its oscillatory dynamics. With this characteristic, it could be termed as stochastic 
resonance with delayed dynamics or, equivalently, a resonance between noise and delay. 

In order to make this point clearer, let us treat the model analytically. The first observation to make with the 
model is that given r, it consists of statistically independent r + 1 Markov chains. Each Markov chain has its state 
appearing at every r + 1 interval. With this property of the model, we label time step t by the two integers s and k 
as follows 

t = s(r+l) + k, (0<s,0<fc<r) (6) 

Let P±(t) = P±(s, k) be the probability for the state to be in the ±1 state at time t or (s, k). Then, it can be derived 
that 

P + (s,k)=a(l- 1 s )+YP+(s = 0,k), 

P_(«, k) = 0(1 - 7 s ) + YP+(s = 0, k), 
P 



/3 = 



p + q 

q 



7=l-(p + ? ). (7) 

In the steady state, we have P+(s — > oo, k) = P + = a and P_(s — > oo,k) = P_ = (3. The steady state residence 
time histogram can be obtained by computing the following quantity, h(u) = P(+; —,u; +), which is the probability 
that the system takes consecutive —1 state u times between two +1 states. With the definition of the model and the 
property of statistical independence between Markov chains in the sequence, the following expression can be derived: 

P(+;-,u;+) = P + (P-) u P + = (pna) 2 (1<u<t) (8) 
= P + (P-y(l-q) = W(a)(l-q) (u = r) (9) 

= p + {P-y{q){i- P y- T {p) = {{iY{p) 2 (u>t) (io) 

With appropriate normalization, this expression can reflect the shape of the histogram obtained by numerical sim- 
ulations as shown in Figure 3. Also, by differentiating equation (|^) with respect to Pl we can derive the resonant 
condition for the peak to reach maximum height as 

q=pr (11) 

or, equivalently, 

L-a=(L + b)r. (12) 

Figure 3 shows how the maximum height changes with p and r. We see that peak maximum is reached by choosing 
parameters according to equation (p]). Also, by changing q, we can control the width and height of graphs in Figure 
4. An example is shown in Figure 5. We note that this analysis for the histogram is exact in the stationary limit, 
which is another feature of the model. 
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FIG. 4. A plot of peak height by varying p The solid line is from equation (9). 




FIG. 5. Resonance curves with various q from equation (9). The parameters are r = 10, and q — (a)0.1, (b)0.2, (c)0.3, 
(d)0.4, (e)0.5. 

We have proposed here a very simple model which nonetheless illustrates resonance behavior between noise and 
delay both numerically and analytically. By relating a and b to the membrane threshold, the model could be used 
as a very simplified and abstracted model of spi king neuron with delayed self-feedback (f|, and could be developed 
for a model of pulse coupled neurons with delay |14|. Also, with the analytically tractable resonant characteristics of 
the model described in this paper, we could possibly seek an application of this delayed stochastic binary element for 
information processing. For example, one may be able to code temporal information stochastically, or an encryption 
scheme might be developed by extending this model |l5|] . Exploration of such applications as well as extension of the 
model into many body systems are the focus of our current research. 



[1] D. H. Perkins, Introduction to High Energy Physics, (Addison- Wesley, Menlo Park, 1987). 
[2] E. M. Purcell, Electricity and Magnetism, (McGraw-Hill, New York, 1985). 
[3] A. Longtin, A. Bulsara, and F. Moss, Phys. Rev. Lett. 67, 656, (1991). 
[4] K. Wiesenfeld and F. Moss, Nature, 373, 33, (1995) 

[5] J. J. Collins, C. C. Chow, and T. T. Imhoff, Nature, 376, 236, (1995); J. J. Collins, T. T. Imhoff, and P. Grigg, Phys. 

Rev. E, 56, 923, (1997). 
[6] A. R. Bulsara and L. Gammaitoni, Physics Today, 49, 3, 39, (1996). 
[7] M. C. Mackey and L. Glass, Science 197, 287 (1977). 



5 



[8] J. Milton, A. Longtin, A. Beuter, M. C. Mackey and L. Glass. J. Theor. Biol 138, 129 (1989); J. Milton and A. Longtin, 
Vision Res. 30, 515 (1990). 

[9] F. Ratliff, B.W.Knight and N. Graham, Proc. Natl. Acad. ScL, USA 62, 733, (1969); F. Ratliff, B.W.Knight and N. 

Milkman, Proc. Natl. Acad. Sci., USA 67, 1558, (1970). 
[10] T. Ohira and J. G. Milton, Phys. Rev. E.52, 3277, (1995); T. Ohira, Phys. Rev. E. 55, R1255, (1997); T. Ohira and R. 

Sawatari, Phys. Rev. E. 55, R2077, (1997). 
[11] Details of the study of this model will be discussed elsewhere. 

[12] H. Gang, T. Ditzinger, C. Z. Ning, and H. Haken, Phys. Rev. Lett. 71, 807, (1993); W-J. Rappel and S. H. Strogatz, Phys. 

Rev. E. 50, 3249, (1994); A. Longtin, Phys. Rev. E. 55, 868, (1997). 
[13] J. Foss, A. Longtin, B. Mensour, and J. Milton, Phys. Rev. Lett. 76, 708, (1996). 
[14] U. Ernst, K. Pawelzik, and T. Geisel, Phys. Rev. E. 57, 2150, (1998). 

[15] T. Ohira, Computer Physics Communications (To be published, Also physics/9804019); T. Ohira, in Proc. 1998 Inter- 
national Symposium on Nonlinear Theory and its Applications (Nolta'98), (Research Society of Nonlinear Theory and its 
Applications, IEICE, Presses Polytechniques et Universitaires Romandes, Lausanne, 1998), p. 295. 



G 



